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ABSTRACT 

In a speech on the current criticism leveled against 
testing 'programs, the speaker states that attacks on testing are 
partially motivated by the public's reluctance to acknowledge 
unpleasant truths about society's weaknesses and problems. Some a f 
these weaknesses are described as the inadequacy of pub'lic education: 
the incompetence of a portion of the labor force, due to academic 
weaknesses, which results in lowered national productivity: 
middle-class students • inflated^expectations, which are not Borne out 
by test results; and individual^' reluctance to be judged by others. 
The speaker asserts that the attacks on testing are now placing more 
emphasis' on the issue of secrecy and -less on racial bias. The speaker 
also d^scussejs the Detroit Edison case, heard before the United 
States Supreme Court, involving test security ? subject 
confidentiality, and job-related tests; in this case, the- criterion 
validity method was used to validate" the tests. -The speaker supports 
the Court's decision to uphold the confidentiality of the test 
questions and the answers, and of the names. and scores of the test 
takers, but believes the, decision was reached for the wrong reasons 
and did not predict the precedent for future cases. (EE) 
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V The War on Testing:; 
Detroit Edison in Perspective 

Barbara terner 



Tests are under attack today, as they fcave been throughout most of 
this decade The battle over test security is only the latest battle in- 
what is turning out to be a long war, increasingly f^ugKt on two* main ' 
.fronts Struggles in courtrooms continue; struggle} in legislative hails 
# are just beginning, and the question we must ask(ourselves. the 
basic, underlying and overriding questidn, is why. 

I believe that the answer is this: Tests are under attack today 
because they tell us truths about ourselves and our society; partial 
truths, to be sure, but truths nonetheless and, £n recent years, many 
k of these truths have been unpleasant and unflattering. Seen in this 
perspective, the attack on tests is, to a very considerable and very 
frightening degree, an attaqk on trutMtself by those who deal with 
appleasant and unflattering truths by denying them and by attacking 
and trying to destroy the evidence for them 

Accordingly, I will begin my presentation here today by briefly listing 
sqme of these unpleasant truths and then go on to make a general 
point atjout how the War against truth is being fought. After that, I will 
focus, in as much detail * time permits, on the specifics of one 
recent battle, the one fought out in the Detroit Edison case. 

Unpleasant truths in the educational realm center around the fact 1 
that our public schools are doing a seriously in^equate job: children 
of the poof are not learning the basics; children of the rich are not * 
learning much beyond the basics We 'know that because we have 
current literacy test results showing how widespread illiteracy is 
among the poor in general and the black poor in particujp, and 
because we have long-term SAT. results showing the magnitude of tft$ 
decline in academic preparedness and competence among the 
college bound 
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In the employment realm, the problem with schooHike paper and 
pencil tests is not that they do not work, the problem is that too many 
of then}' work too well and tell Os another unpltfasfcnt truth: poor 
students frequently make poor workers This is s<j because the skills 
needed for competent performance in business, industry, and 
government are, increasingly, the same skills needed for competent 
performance in school Tests tell us this unpleasant truth and they 
are beginning to tell us some even m©r§ unwejcome^ones about the ' 
relationship between intellectual competence and national 
productivity, and about the escalating price we are paying for 
inbompeterfce in an increasingly competitive world market 

Gn a more personal, individual level, tests tell us that the grandiose 
self evaluations and inflated expectations for success and stardom 
increasingly common among 'some middle-class youths are-just that 
grandiose and inflated In focusing on self-indulgent, narcissistic • 
youth of this sort al this point. I do not mean to suggest that they arS 
the only ones who bitterly resent objective evaluations and respond 
by attacking then equators and the instruments they use. 

fader's young raidets are, after all, relatively fresh troops in this 
yfar Leaders of the NEA preceded them in combat, calling for a 
national moratorium the very tests that showed what an 
inadequate educational job they were dofng Leaders of the NAACP 
also attacked test results early on, and continue to do so, because ,j 
they show that integration alone cannot solve the problems of 
illiterate black youth ^ 

It is. however, potentially misleading to concentrate only on these 
and other self identified opponents of testing and of truth We all 
want to be tfie judges of our own competence, and we ail are, to " ' 
some extent No one questions our right to be that The only/eal 
question here is whether any of us also have the right to be 'the sole 
judges of our own competence, and the answer is no, not if we value 
froth and want to stay in touch with external reality 

That m brief, is whf the war is being fought Turning now to the how 
question the general pomt I want to make is this The war against 
testing is being fought largely with euphemisms, for reasons that are 
impltcif in the foregoing analysis Our society'does have many 
troubling problems- right now but poll data show that most Americans, 
black and white, sjifl value truth, competence, and objective 
evaluation More heartening still, they have shown an impressive 
ability tc* organi/e themselves to insist on these essentials when 



necessary, as the enormous and effective popular support for the 
minimum competence testing movement shows 

,Jn this climate no one us yet ready to come out of the closet and 
march in the open against truth competence, and objectivity/ As a 
result, those who attack tests and the truths they represent always 
insist trial they are attacking somethmg^ise Initially, the something 
else was "racism Now "secrecy is the main code word a word 
made fashionable by the sunshme-m-government and-the-universe 
■ boys I will get to those boys, and girls, in a moment 

Hrst. however. I want to note tor the record, that I have talked and 
written a) length, elsewhere about the falsity of the charge that valid 
tests are racist in design or .effect, and will not dwell on those issues 
here, except to make one point Overprivileged white opponents of 
testing outnumber uRderpnv.leged black ones and always have not 
only in absolute numbers but in relative, proportional terms as well ■ 
What they have discovered m recent years is that they cannot fully 
achieve then ends s.mply by pretending to champion what they claim 
is* the cause of black- people * 

That was always true but it became especially clear after (he 
decisions m !he tUikkeand Weber cases were handed down Since 
the Court has decided.' for the moment, to try to help black people 
with academic and vocational problems by giving them frank special 
preferences, .t is likely to be somewhat less receptive to the pretense 
that tests -do not provide valid measures of at least some important 
competencies Hence the need for a new nonracial code word, ' 
secrecy, and a new line pf attack 

' ' ' 'I 

Two maior battles, have been fought under the new euphemistn the 
one over the I aValle bijl in New York and the one over the Detroit 
fdrson case in the-Supreme Court, and conventional wisdom has it 
that ant,. testing lobbyists won the first^battle. but 'lost the second 
one l agree th,ft the [ aVaile bill a baa"W and I am sorry thai it 
was enacted into law in Net* York I wish I could take comfort from 
the Dvaoit f usion decision., and offer some, but honesty compels me 
to report that the comforts it offers are rather cold pries 

In saymq that l do not mean to gainsay the facf that onthe day the 
Oftuvt fdrson case was deeded gained, a little,' on the sunshme- 
in government apd the universe boys Now. many of my old friends of 
both sexes fall mty that category they are people who crusade for 
openness and f u H disclosure, from almost everyon»*anri about almost 
everything , r , what they see as a holy war against the near global' 



evil of secrecy Listening to them, over the years, I have become 
more and more firmly convinced that allowing a little "secrecy" In 
drderjo preserve some privacy" is a wise choice, and an essential 
one for a free society Accordingly, I am happy that the Supreme ' 
Court made that choice in this particular case, but I am very unhappy 
about how it was made 

Privacy' is, of course, the word most people use to refej; to what 
Mr. Justice" Brandeis called the right to betet alone" when it is 
asserted by pefsons or organizations they approve "Secrecy'' is 
whaMhey call that same right when it is ^asserted by persons-w 
organizations they disapprove This unprincipled way of making 
decisions on the basis of whoSe ox is gored was always deplorable, 
and it becomes increasingly dangerous as 1984 approaches. Neutral 
principles, ctearly articulated and consisjently applied, can save us' 
from the world George Orwell foresaw, piecemeal victories cannot, 
especially when they rest on an unprincipled basis, as the decision in 
the Detroit Edison case does Let there be no confusion about my 
pomt here I applaud the result the Court reached what i deplore are 
the reasons the Court*ga*e for reacfitfig rt because they set no limit ' 
on the personal predilections of individual judges and provide no firm 
basis for predicting what the Court will do next time 
• 

To understand why the Court should have done what it did but on a 
different basis, it is necessary to look at all of the relevant facts in 
that case, to place them in context, and to see them in perspective. 
Looking first at the most obvious facts, Detroit Edtson dealt with 
questions of test security and subject confidentiality and resulted in a 
temporary victory for those twin interests, albeit a narrow and 
precarious one -Psychologists and their colleagues in that case 
upheld the standards of the American Psychological Association with 
integrity and grace, bending over backwards to make every arguably 
reasonable concession, but held firm on the essentials, refusing to go 
public with all of then test questions and answers or to release lists 
pairing the names of test fakers with their scores 

Union officials, backed by the NLRB and by the Sixth Circuit * 
Appellate Court, demanded that they do just that by releasing the 
aforementioned data .to persons not bound by the Code of Ethics of 
this organization Colleagues here today w<j[f#^teadfast in their 
refusal to violate the code and, ultimately, JheSupremte Court upheld 
their right to refuse in a 5-4 decision The Court reached that 
'decisiorrby weighing and balancing the interests at stake on a purely 
subjective scale and decided that the company's interest in test 
security and subject confidentiality outweighed the union's interest in 



obtaining those data in this particular case, and that the NLRB had 
therefore exceeded its remed.al discretion m ordering disclosure , 

The important point to note here, for those who are concerned as we 
all should be, about what the Court may do next time is this The 
Court explicitly refused to hold that the union had no legitimate 
interest in the data it sought, hence, no right to it, substantial or 
unsubstantial To undersand why, in truth arid in fatness the Court 
should have held that the un.on had no right to those data although it 
did have a right to a carload of other data which the company and its 
psychologists willingly supplied, it is necessary to know three 
additional facts about this case (1) The test at issue in the Detroit 
td,son case was a validated test, (2) the method used to validate it 
was the criterion validity method, and (3) the criterion utilized was 
clearly job-related 

Under these circumstances, what legitimate interest could the union 
representing disgruntled workers who failed the test, have in" 
obtaining all of the actual test questions and answers, let alone the 
scores obtained by each named'individual who took it? Data of toat 
sort are useful in attacking the face validity of test items* Such 
attacks are fair and relevant when— and only when— test use is 
justified on the basis of .face validity I personally believe that test 
use can be justified on that basis in some situations„just as nontest 
methods of decision-making can be The Supreme Court has 
however, held otherw.se, setting what is, in'effect. a double standard 
requiring stringent validity for decision-making based on tests but 
countenancing face validity alone for decisions about the very same 
matters made on nontest bases * 

Faced with this situation, the company in this case nonetheless ' 
chpse to use tests as a basis for deciding which workers were 
competent for promotion to the job of instrument-person B arid they 
-expended the time.-gffort, and money necessary to meet the 
stringent standards required to establish. criterion validity for their 
test Apparently, they succeeded only too well from the point of view 
of the disgruntled workers the union represented 

If they had not. union officials Would have been content to attack the 
validity of the test and the decisions based upon it tn fair £Tnd > 
relevant terms, and they* would have won Certainly, union officials 
had every right to data relevant to such an attack and. in fact they 
received those data from the company without judicial compulsion 

'See ?!fl NlHB tOi'4. 1030 (I9i".i . 



r 

8 



\ 



« 

Union officials were not. however content to mount a fair attack on 
the criterion validity of this test because" they rightfully perceived that 
the relevant data showed that the workers they represented were not 
competent for the promotions they wanted 

The Court declined to order the company and the psychologists who 
worked for it to surrender data relevant for an unfair attack on this 
particular criterion valid test in this particular situation, but it refused 
to do so on the basis of a legal principle or rule that would prohibit 
similar attacks on similar testsVn future situations The legal rule they 
should has?e adopted is the obvious and obviously (air one 
Arguments about the face validity of test items die relevant only 
when test use has been justified on that basis ' ■' 

Such a rule would provide a neutral, principled basis for cons.stent 
tudicial decision-makinq m future cases, it could not be used as a 
basis for capricious and arbitrary decisions for or against future 
plaintiffs or defendants because it wtjuld establish a precedent 
binding upon the Court that issued it and on all lower courts 
governed by .«> rulings Th 3 t is what" legal decisions in general and 
Supreme Court decisions m particular are Supposed to do. 

Decisions made by weighing and balancing legitimate and illegitimate 
interests ontfhe same subjective scale are baddecisions- 
irrespective of the results reached- ■because they do not do that 
Instead they iftave the Court with, unlimited, illicit discretion of the 
son Mr Justice-frankfurter condemned when he said. "We do not sit 
like ;j Khadi undei\ tree dispensing |ustice" 

fhe truth is that the ,ust«ces of 'our current Court do something very 
much like mat in a distressingly high proportion of their cases and 
as a result, the next few years are likely to be difficult ones Still I 
am convinced that intellectual honesty and integrity will win in the 
end as th»»y generally do, in this oftert troubled but ultimately 
triumphal country 0 I ours Jq rjjako that win more likely, it would be 
useful il scholars scientists and lawyers who have-not yet stood up 
to be counted on this issue did so. soon 
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